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® Method and apparatus for reducing conversion artefacts. 



@ When film Is transmitted by television, the same 
frame of film is used to generate both interlace 
television fields. This results in the information car- 
ried by the second field being temporally displaced 
from the original by 20ms. This displacement gives 
rise to judder and double image artefacts in the 
received image. 

To overcome these defects the intermediate fields 



are generated from the original film frames by dou- 
ble sided motion compensated interpolation wherein 
the motion information is calculated using double 
sided block matching. The invention may be applied 
either in a television receiver or video signal decoder 
or in tiie television studio before the television signal 
is transmitted. 
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The present invention relates to a method and 
to an apparatus for reducing conversion artefacts . 
when progressive film source images are converted 
into interlace format of at. minirhum doubled picture 
frequency. 

Background 

50Hz television systems transmit one complete 
image every 1/25th of a second, using a system : 
known as interlace which transmits one half image 
every 1/50th of a second, followed by the other half 
image 1/50th of a second later. Television cameras 
also operate using this interlace system, and so the 
original scene captured by the camera is displayed 
on a receiver with no motion problerris. This is 
represented diagr^matically in Rg. 1. Time T is 
. shown along the horizontal axis with the parallel 
arrows representing the sampling of the image 
which consists of alternate first FI1 and second FI2 
fields. In this case, one half image is sampled 
every 1/50th of a second, that is the field period 
FIP. Horizontal position X is shown along the verti- 
cal axis, and the length of the arrows represents 
the position of the object as It moves. By drawing a 
line through the tips of the arrows, the trajectory 
TOO of the object may be observed. For this 
example, an object is depicted moving horizontally 
with a constant velocity. 

Film, on the other hand, is a sequence of complete 
images, generated at a rate of one new image 
every 24 times of a second. When film is transmit- 
ted on television, the projection rate is 25 images a 
second to give simple compatibility with the televi- 
sion system. Inaccuracies in movement speed and 
audio pitch are ignored. This is shown in Fig. 2 
using the same conventions as for Rg. 1 and a 
frame period FRP. The same trajectory TOO is 
traced by the object as it moves across the image. 

When film is transmitted by television, the 
same frame of film is used to generate both inter- 
lace television fields. This results in the information 
carried by the second field being temporally dis- 
placed from the original by 20ms. This is shown in 
Fig. 3. This displacement gives rise to two percep- 
tible artefacts in the received image. 
The first is a double image, and arises from the 
expectancy of the human visual system that ob- 
jects move with a constant or smoothly changing 
velocity. The brain perceives two objects moving 
with the same velocity, separated by the distance 
which the original object travels in 20ms. This is 
represented by the double trajectory DTOO drawn 
through the tips of the arrows. The second artefact 
is that , of judder, caused by the apparent updating 
of the position of each object only once every 
1/25th of a second, a time interval sufficiently long 
for individual images to be perceived as such rath- 



er than combining together to. give the appearance 
of smooth motion. 

Invention 

5 . 

It is one object of the invention to disclose a 
method for reducing or even eliminating motion 
judder when progressive source images are dis- 
played in interiace format. This object is reached 
TO by the method disclosed in claim 1. 

It is a further object of the invention to disclose 
an apparatus which utilises the inventive method. 
. This object is reached by the apparatus disclosed 
in claim 8. 

75 This invention is suited for the removal of film 
judder in TV systems and may be applied either in 
a television receiver or video signal decoder or in 
the television studio before the television signal is 
transmitted. 

20 To overcome these defects the Intermediate fields . 
are generated from the original film frames by a 
process of motion compensated interpolation. The 
motion compensation measures the velocities of 
moving objects and generates the intermediate 

25 fields having moving objects correctly positioned 
so as to remove the above mentioned artefacts and 
to create, in this example, a single corrected trajec- 
tory CST. This is shown in Rg. 4. Each original first . 
field OFFI is followed by a motion compensated 

30 second field MCSFI depicted by a dashed line. 

Advantageously, the invention can be used for 
100Hz upconversion of a film source, suitable for 
display on a TV receiver with 100Hz scanning. In 
this case each original first field OFFI is followed 

35 by three interpolated fields MCSFI (dashed and 
dotted lines). 

In principle, the inventive method is suited for 
reducing conversion artefacts when progressive 
film source images are converted into interiace 

40 format of at minimum doubled picture frequency, 
whereby motion compensated fields of said inter- 
lace format are generated between non-motion 
compensated fields of a preselected type - e.g. 
each first field Advantageous additional embodi- 
es ments of the inventive method are resulting from 
the respective dep>endent daims. 

In principle, the inventive apparatus for reduc- 
ing conversion artefacts when progressive film 
source images are converted into interlace format 

50 of at minimum doubled picture frequency, includes: 

- interlace-to-progressive converter means 
which combine each two received fields of 
said into interlace format converted film 
source Images to recreate the original film 

55 source image; 

- motion estimation means which calculate mo- 
tion vectors for each pixel in said recreated 
images; 
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- subsequent vector post-processing mfeans- 
which correct the motion vectors calculated in 
said motion estimation means; 

- double sided motion compensated interpola- 
tion means which operate oh the appropri- 5 
ateiy delayed recreated imaiges using said 
con-ected motion vectors; 

- switching means which select either an ap^ « 
propriately delayed field of said received 
fields of the into interlace fbmnat converted io 
film source images or an interpolated output 
field from said motion compensated inter- ^ 
potation means. 

Advantageous additional embodiments of the 
inventivie apparatus are resulting from the respec- 75 
tive dependent claim. 

Drawings 

Preferred embodiments of the invention are . 20 
described with reference to the accompanying 
drawings, which show in: 

Rg. 1 trajectory of a moving object in case 
of interlaced images from a camera 
source; 25 

Rg. 2 trajectory of a moving object In case 
. of images from a film source; 

Rg. 3 trajectory of a moving object in case 
of interlace-displayed images from a 
film source; 30 

Fig. 4 corrected trajectory of a moving ob- 
ject in case of interlace-displayed im- 
ages from a film source, wherein ev- 
ery second field or three of four fields 
are motion compensated; 35 

Rg. 5 inventive apparatus; 

Rg. 6 progressive scan generation from film 
source being transmitted with inter- 
laced pictures; 

Rg. 7. two-sided block matching; 4o 

Rg. 8 double sided motion compensation. 

Preferred embodiments 

One implementation of an inventive apparatus 45 
is shown in Rg. 5. In a studio environment this 
would be placed on the output of a telecine or 
other film projection device. In a television receiver 
this would be enabled when film was being trans- 
mitted, either by a signalling means external to the so 
video signal, or by a film mode detector, for exam- 
ple that described in EP-A-0567072. In this detec- 
tor it is checked for every vertically adjacent pixel 
pair, if the amplitudes of the vertically intermediate 
pixels of the both adjacent fields lay between the 55 
amplitudes of the pixel pair. These comparison 
results are combined within each field. For setting 
film mode the combination results must be equal to 



a specific pattern within a diistinct number of fields. 
The reset criterion is less strong. Within a distinct 
number of fields a specific number of 'wrong* com- 
bination results may occur. The film mode is 
switched off if this specific number is exceeded. 
The first field, or half image. OFFI of the input 
signal IN contains the information in the conrect 
temporal position. This field undergoes no further 
processing and is output directly after a suitable 
compehisating delay t1. The motion compensated 
second field MCSFI is generated by the subse- 
quent processing. The first processing step is to 
combine the two received fields in interlace-td- 
progressive converter means IPCS to recreate the 
original film image. The function of IPCS is de- 
picted in Fig. 6. Time T is again represented by. 
the horizontal axis. The vertical axis represents the 
vertical position V. It Cain be seen that the progres- 
sive scan image output frame OFR is recreated by 
delaying the first field FI1 with respect to the sec- 
ond fiekJ R2 by one field period FIP. 
The next step in the process is to calculate the 
motion of each jx)int in the image within motion 
estimation means DSME. This may be done by a 
number of different means, using different types of 
motion estimation and a frame memory FRM1. As 
long as the result of the process is a motion vector 
associated with each point in the image, centred on 
the temporal position of the desired output field 
MCSFI. the precise means to provide these vectors 
is unimportant, aside firom the fact that different 
methods will provide different levels of perfor- 
mance for different costs. 

In the embodiment described here, this motion 
estimation is done using double sided motion es- 
timation based on the luminance signal, described 
fully in EP-A-93402187 of the applicant. Essentially, 
this is a full search block matching process with 
the search window centered on the current block 
position CBP of the interpolated output field IFI. as 
shown in Fig. 7. The backward half of the motion 
vector BHMV has a landing point within the back- 
ward search window BSW of a backward field BFI. 
the forward half of the motion vector FHMV has a 
landing point within the forward search window 
FSW of a fonftrard field FFI. 

Each successive pixel block CBP of a current 
field or frame IFI is matched with respective can- 
didate pixel blocks within search window BSW - 
which has a preselected window width - of the 
backward field or frame having a half of said 
preselected width and with the corresponding pixel 
blocks within the corresponding search window 
FSW of the forward field or frame having a half of 
said preselected width in order to select a motion 
vector, the first part of which Is related to the 
location of the best matching block of the backward 
field or frame and the second part of which is 
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related to the location of the best matching block of . . 
the forward field or frame, whereby the cunrent 
position of said search windows BSW and FSW is 
related to the position of the current pixel block of i 
said current fiejd or friame. . 5 

The result of this block matching yields a num? 
ber of candidate vectors for each block which are/ 
then post-processed in Subsequent vector post-^ 
processing means VPP. In this means, the motion*, 
vectors' are corrected. i.e. are made reasonable, . .: id 
and smoothed. 

This can be performed as describefd in ER-A- 
93402188 of the applicant to provide a final output; ... 
vector for each pixel, representing the best es-, m 
timate of th^ motion of that pixel. . . . 75 

For this estimation a motion vector related to each 
block is calculated<and for any pixel of the current- 
block, a pixel motion vector is calculated; using four . 
motion vectors, that is the motion vector of the 
current block and the motion vectors of the three * 20 
adjacent blocks. o 
For any pixel from error values related to the four 
block motion vectors several estimated errors can 
be cateulated. taking into account the position of 
the pixel relative to the centre of each of the 25 
corresponding blocks, whereby the minimum of 
said estimated errors is taken to select the related . • 
of said four block motion vectors as the final mo- 
tion vector for said pixel. 

Advantageously, the post-processing means 30 
VPP may also attempt to correct for the effects of 
repeated structures as descrit>ed in EP-A- 
93402507 and localise the block based motion vec- 
tors to provide one motion vector per pixel. 
Such correction of motion vectors includes the 35 
following steps: 

- evaluating error values which are related to a 
matching of said pixel blocks between dif- 
ferent pictures of said video signal, whereby, 
additional to a basic minimum error, a further 4o 
minimum error bebnging to adjacent pixel 
positions, except directly adjacent pixel posi- 
tions, is searched along the row, or column, 
containing the pixel position of said t)asic 
minimum error; 45 

- comparing said further minimum error with a 
preselected threshold, resulting in a periodic 
structure decision if such further minimum 
error is less then said threshold; 

- when a periodic structure in the picture con- so 
tent is detected, replacing the current motion 
vector corresponding to said basic minimum 
error by a motion vector of an adjacent pixel 
block, in particular either from the block to 

the left or from the block above, whichever 55 
yields the smaller error in the cunent block, 
or by taking the mean of these both vectors. 



In ^addition,, a measure of confidence of. the 
rnotion vector can be generated in VPP on a pixel 
by pixel basis as described in. EP-A-93402506 of 
the applicant When the confidence is low, there is . 
a high prot>ability that the motion vector is incorrect 
(for example, on material newly uncovered by the 
passage of a moving ot>ject for which no motion 
information can be cx)rrectly found). In this case, a 
default motion vector of 0 in both, the horizontal 
and vertical directions is taken. 
For such ifneasure of confidence, signal paths with 
different interpolation processing - in particular mo- 
tion compensated interpolation and fallback inter- 
polation - are formed, whereby the . output signals 
of said different signal paths are combined in relar, 
tion to a measure of confidence which is derived 
from a minimum motion estimation error of the 
Input video signal, which is in particular block 
based. 

DSME may use a non-uniform measurement of 
candidate motion vectors as described in EP-A- 
93402059 of the applicant to calculate the motion 
vectors. The accuracy of this measurement is 
made non-uniform within the search window by 
dividing the window Into, at minimum, an area of 
high precision and an area of lower precisioni 
whereby the density of the used pixel values of the 
input signal for the motion vector calculation is less 
than in the area of less precision. 

The range of the search in both the horizontal 
and vertical directions is only limited by constraints 
of cost and complexity. 

The output vectors of VPP are applied to dou- 
ble sided motion compensated interpolation means 
DMCI, shown in more detail in Rg. 8, which may 
use a further frame memory FRM2 and which 
generate from the appropriately delayed (furtiier 
delay means t2) progressive picture signal a mo- 
tion compensated output image IF12 (progressive 
frame or field) in the temporal position of the sec- 
ond field FI2 of the television image. Each output 
pixel IP at the position of zero vector ZV is the 
average of one pixel in the current tilm frame CFR 
and one pixel in the previous tilm frame PFR. The 
two pixels used in the average are selected by 
applying the measured motion vector (one half 
HMMVP in frame PFR and one half HMMVC in 
frame CFR) for the desired output pixel. If this 
vector represents accurately the direction of motion 
DM, these two pixels will con'espond to ttie same 
part of the same object in each frame. 
As shown in this embodiment, a complete progres- 
sively scanned image can be generated in the 
position of field FI2. 

In case of 100Hz output DMCI interpolates three 
intermediate motion compensated output images 
IFI2 (progressive frames or tields). whereby re- 
spective percentages of the components of the 
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motion vectors can be applied to the interpolation 
of a specific of the three images. 
The final step, which may be combined In the 
interpolator DMCI by directly interpolating a field or 
threie fields only, respectively, is to produce the s 
output field, or fields^ MCSFI from the interpolated 
infonmation. This is done by taking every second 
. line from the progressive image. 
Switch means SW select either field FI1 or the 
newly generated field, or fields, MCSFI at the out- io 
put OU of the inventive apparatus depending on 
the field being transmitted. 

Colour information can .be handled in exactly 
the same way as luminance for the interpolation 
process, using the motion vectors derived for the is 
luminance signal. 

The invention can also be used in a video 
signal decoder (TV, VCR. PC, CD-I. CD Video) if 
the transmitted or recorded signals have been cod- 
ed using data reduction, e.g. MPEG1 or MPEG2, In 20 
such cases the transmitted/recorded motion infor- 
mation can be used in, or instead of, circuits DSME 
and/or VPP. 

In case of other film picture rates or field rates 
(120Hz) the numbers given can be adapted cor- 25 
respondingly. 

When implementing the referenced matters 
into the invention the length of the therein-de- 
scrit>ed field and frame delays is adapted cor- 
respondingly. 30 

The order of usage of the fields can be ex- 
changed, i.e. field OFFI can be the second field 
FI2. 

Claims 35 

1. Method for reducing conversion artefacts 
(DTOO) when progressive film source images 
are converted into interlace fomnat of at mini- 
riium doubled picture frequency, characterls- 40 
ed in that motion compensated fields (MCSFI) 

of said Interlace format are generated (DMCI, 
PIDS, SW) between non-motion compensated 
fields (OFFI) of a preselected type - e.g. each 
first field (R1) - of said interface format. 45 

2. Method according to claim 1, characterised 
In that three motion compensated fields 
(MCSFI) are generated between each pair of 
said non-motion compensated fields (OFFI). 50 

3. Method according to claim 1 or 2, charac- 
terised In that said generation of motion com- 
pensated fields (MCSFI) takes place in a televi- 
sion receiver or video recorder or video de- 65 
coder for correction after transmission or in a 
studio for correction before transmission or re- 
cording. 



4. Method according to any of claims 1 to 3. 
characterised In that for determining (DSME) 
motion information for said motion compensa- 
tion a full search block matching is performed 
with the search window centered on the cur- 
rent block position (CBP) of the Interpolated 
output field (IFI), whereby the backward half of 
the motion vector (BHMV) has a landing point 
within the backward search window (BSW) of a 
backward field (BFI) and the fonvard half of the 
motion vector (FHMV) has a landing point with- 
in the fonftrard search window (FSW) of a for- 
ward field (FR). 

5. Method according to any of claims 1 to 4, 
characterised In that said generation of mo- . 
tion compensated fields (MCSFI) is perfonned 
(DMCI. FRM2, PIDS) using double sided mo- 
tion compensated interpolation. 

6. Method according to any of claims 1 to 5. 
characterised in that said film source images 
have been digitally coded using data reduction 
and respectively decoded prior to said conver- 
sion, in particular by using MPEGI or MPEG2 
coding and by using, the motion information 
related to this coding for said motion com- 
pensation. 

7. Apparatus for reducing conversion artefacts 
(DTOO) when progressive film source images 
are converted into interlace format of at mini- 
mum doubled picture frequency, related to a 
method according to any of claims 1 to 6 and 
including: 

- Interlace-to-progressive converter means 
(IPCS) which combine each two received 
fields of said into interlace format con- 
verted film source images to recreate the 
original film source image (OFR); 

- motion estimation means (DSME, FRM1) 
which calculate motion vectors for eacii 
pixel In said recreated images (OFR); 

- subsequent, vector post-processing 
means (VPP) which correct the motion 
vectors calculated In said motion estima- 
tion means: 

- double sided motion compensated inter- 
polation means (DMCI) which operate on 
the appropriately delayed (t2) recreated 
Images (OFR) using said corrected mo- 
tion vectors; 

- switching means (SW) which select ei- 
ther an appropriately delayed (t1) field of 
said received fields of the into Interlace 
format converted film source images or 
an interpolated output field from said mo- 
tion . compensated interpolation means 
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(DMCI). ;■ ^ . : 

8. Apparatus according to claim .7, characteris- 
ed In th^t in .said motion estimation m 
(QSME^<FRM1) a full search block matching is 5 
performed with the search window centered on 
the current block position (CBP) of the interpo- 
lated output field (IFI), whereby the backward 
half of the motion vector (BHMV) has a landing 
point within, the backward search window io 
(BSW) of a backward field (BFI) and tiie for- 
ward half of the motion vector (FHMV) has a 
landing point within the forward search window 
(FSW) of a forward field (FFI). 
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